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Abstract 

In  this  study  we  extend  the  global  stability  results  of  the  previous  report  [1].  We  focus  on  the  scenario  of  a 
single  TCP  flow  with  proportional  AQM  controller  at  the  router.  By  using  Lyapunov  functional  method,  we  are  able 
to  prove  the  global  stability  of  such  nonlinear  system  with  feedback  delay. 


I.  Introduction 

Recent  studies  on  the  behaviors  of  TCP  and  the  design  of  AQM  (Active  Queueing  Management)  algorithms 
at  bottleneck  routers  rely  heavily  on  stability  conditions  for  the  TCP  system.  Based  on  local  linearized  analysis, 
performance  of  RED  (Random  Early  Detection)  has  been  studied  (  [2],  [3]),  and  various  AQM  algorithms  have 
been  proposed  (  [4],  [5],  etc)  to  achieve  certain  performance  metrics. 

Since  near  equilibrium  analysis  only  gives  necessary  stability  conditions,  it  is  very  important  to  know  whether 
the  rules  obtained  from  those  local  analyses  can  be  applied  to  the  global  situation.  Efforts  have  been  made  in 
this  direction  in  the  past  few  years.  Due  to  the  complexity  of  the  TCP  dynamics  coupled  with  network  feedback, 
results  are  often  dealt  with  some  simplified  descriptions  of  TCP  (no  delay  and/or  single  flow  and  single  bottleneck 
router)  or  stability  condition  on  a  very  restricted  region  around  the  equilibrium  state  (  [6],  [7]).  A  typical  method 
is  applying  Razumikhin  thoerem  with  quadratic  Lyapunov  functions.  Since  the  conditions  in  Razumikhin  theorem 
when  using  a  simple  quadratic  Lyapunov  function  often  result  in  a  very  conservative  estimated  stability  region,  it  is 
desirable  to  expand  the  estimated  stability  region  by  using  a  more  sophisticated  Lyapunov  functional.  This  report 
explores  this  approach  on  a  single  flow  single  bottleneck  case. 

There  are  also  numerous  studies  on  the  global  nonlinear  stability  problem  of  network  communication  system 
other  than  the  TCP  system  we  consider  here.  Rate  control  network  is  especially  well  covered.  Some  powerful 
tools,  such  as  passivity  theory  [8]  and  ISS  Small-Gain  theorem  [9],  are  successfully  used  to  obtain  robust  stability 
conditions  for  this  type  of  network.  Recent  study  [10]  shows  the  relationship  between  the  fluid  flow  model  and  the 
underlying  discrete  time  system  in  determining  the  global  stability  condition.  However,  due  to  different  dynamical 
structure  and  feedback  information,  these  methods  cannot  be  directly  applied  to  the  system  we  consider  in  this 
report. 

This  work  continues  part  of  the  research  in  [1],  which  considers  the  heterogeneous  TCP/ AQM  network  without 
feedback  delay.  We  try  to  establish  global  stability  condition  for  a  single  flow  single  bottleneck  router  network  with 
proportional  controller.  It  turns  out  that  a  properly  chosen  Lyapunov  functional  shows  the  system  is  globally  stable. 

II.  Global  Stability  of  TCP  systems 

We  only  study  a  single- flow  scenario  with  a  proportional  (linear)  queue  marking  function  at  the  bottleneck  router. 
Consider  a  TCP/ AQM  dynamics  described  as  below, 

r  =  - - “  ^r{t)2kq{t  -  r), 

Q  =  ( T-C)+ , 

r  and  q  are  TCP  rate  and  bottleneck  queue  size  as  usual  and  k  is  the  slope  of  the  marking  function.  By  re-scaling 
the  time  t  =  ts  to  normalize  the  delay,  we  get 

r  =  —  - — -  —  r(r/2  +  C)kq(s  —  l)r  (s) 

q  =  rr.  (1) 

Here  we  let  r  =  r*  +  f  and  q  =  q*  +  q,  where  r*  =  C  and  q*  =  k~ 1  ((l  +  C2t2/ 2)  1 )  are  equilibrium  rate  and 
queue  length  respectively. 
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Firstly,  let  us  restate  the  local  stability  condition  for  (1)  [1],  The  linearized  version  of  (1)  is 

f'(c f) 

r  =  ~  Tf(g*)  5  ~  X)  ~  T/(g*)^(g) 
q  =  rf, 


(2) 


and  we  have 

Lemma  1:  Suppose  f'(q*)  <  0.5006  and  let  f&,  k  =  {0, 1}  be  the  solutions  of  the  following  equation, 


cot. 


=  /V)(l  +  ^Ca/2) 


COS  OJk 

and  coq,  u)\  be  respectively  the  first  and  the  second  smallest  positive  co  €  [0, 7r/2]  satisfying 

oja  tan2  co 


cos  CO 


CO 


/V)  + 


=  1. 


(3) 


(4) 


2 f'(q*)  cos  a; 

If  to  <  t  <  ft,  then  all  the  characteristic  roots  A (r)  of  Equations  (2)  have  negative  real  parts.  There  is  an  infinite 
series  r^,  k  =  0, 1, . . .,  such  that  there  are  exactly  2  pure  imaginary  roots  when  r  =  t*.  A(r)  is  differentiable  at 
t  =  t\,  and  ReA'(fi)  >  0.  If  f'{q*)  >  0.5006,  the  system  (2)  is  unstable  for  all  r.  For  r  >  t\,  there  are  precisely 
two  characteristic  roots  A  of  Equations  (2)  in  the  region  ReA  >  0  and  —  n  <  ImA  <  7 r. 

We  have  the  following  result  for  the  global  stability  condition  for  (1). 

Theorem  1:  Suppose  tC  1,  we  can  choose  k  to  make  the  system  (1)  globally  stable. 

Proof:  Local  linear  stability  result  in  Lemma  1  tells  us  when  tC  1,  we  can  choose  k  =  4C-3t-3  to  obtain 


local  stability.  For  simplicity,  let  us  denote  ip{t)  =  [r(t).  q(t)]r. 
with  bounded  variation  on  [—1,0]: 


r]{s)  = 


[0  0;  0  0], 

[0  —  /q*]  0  0], 


Also  denote  rj  as  a  2  x  2  matrix-valued  function 

5  =  -1 
-1  <  s  <  0 


[—rCkq*  —  T  1/q*-1T  0],  s  =  0 
It  is  easy  to  see  that  the  linearized  version  of  (1)  can  be  written  as 

j>(t)  =  f  dn{0)i/>t{0). 

From  [11],  we  can  choose  the  following  Lyapunov  functional  for  (1), 

v{f)  =  ^T(o)y  (0)^(0) 

+ 


/0  r  0 

/  Y(—u  +  6)dri(u)'ip(6)dd 
-1  Ju 


a: 


+ 


dsip  ( s)di]  (h) 


i-i J-h 
r0  rO 

1-1  J- 1 


Y  (— s  +  h  —  u  +  9)dr](u)ip{6)dd 


(5) 


It  is  known  that  if  (1)  is  locally  stable,  we  can  find  Y  e  C([— 1, 1] ,  R2x 2 )  satisfies  F(0)  +  yT(0)  =  —  W  where 
W  is  a  positive  definite  matrix.  Here  F (0)  is  defined  as  d+Y(0)/dt,.  Then  V('iJ>)  is  positive  definite  if  Y  satisfies 
additionally: 

(i)  Y  (t)  is  continuously  differentiable  for  t  f  0. 

(ii)  F(0)  is  symmetric  and  Y(t)  =  YT(—t). 

(iii)  Y (t)  =  /[°,  dr]T(s)Y (s  +  t). 

Take  the  derivative  of  V  (/i/j)  we  can  show 

Vf  =  -■0t(O)VF^(O)  -  2/cr(f(0)q(-l)/2  +  q(-l)C) 
x  (r(0)q(0)yi2(0)  +  f(0)2Fn(0)) 
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Denote  Y(t)  =  [y\  2/2;  2/3  2/4] .  From  the  conditions  at  which  Y(t)  has  to  satisfy  we  have 


in (*)  m(t) 

—  kCq*r  t 

yi(t)  2/2 (t) 

1 

■ 

0 

0  ’ 

2/1(1  —  t)  2/2(1  —  t) 

1 - 

co 

1 _ 

0  0 

1 

co 

C-+- 

<?*+> 

1 

“h 

l-w  °J 

.2/3(1  -t)  2/4(1  -t) 

We  can  solve  the  above  equation  explicitly.  By  some  calculation,  yi(t)  is  the  solution  of  the  following  fourth- 
degree  differential  equation, 

y[4)  -  k2C2r2q*2y^  -  -^2/1  =  0. 

Given  initial  condition  2/1  (0)  =  —1/2,  a  solution  of  the  above  equation  is 

Vi(t)  = 

where 


u  = 


1  ( u 2  +  kCTg*u)e~ut  -  g*— VF— !) 
2  u  u2  +  kCrq*u  +  q*~1e~u 


k2C2T2q*2  |  / kACATAq*A  |  1 


*2 


It  is  easy  to  see  that  when  tC  1,  u  =  2/(tC )  and  yi(t)  =  (1  —  t)/ 2.  We  can  also  deduct  the  following 

relations, 

2/3(1)  +  -^  =  1/3(0), 

rq* 

and  for  Y(0)  +  YT(0)  = -W  =  -[VFi  W2 ;  W2  W4], 

(  22/(0)  =  -1, 

I  -kCTq*y2{0)  +  ry4(0)  -  (rq*)  VW  =  W2, 

{  — 2(Tq*)-1y3(l)  =  W4. 


So  we  can  set  2/2(0)  =  2/3(0)  =  r  lq*  ,  and  choose  2/4(0)  properly  so  that 


W  = 


-1 
0  -- 


0 


<  0. 


Now  V(ip)  becomes 


V(ip)  =  — r(0)2  —  2r_2/q*q(0)2  —  2A:r(r(0)q(— 1)/2  +  q(  — 1)C) 

x  (~7^(0)//(°)  +  ^(0)2)- 
rq  Z 

Suppose  q  is  confined  in  the  region  [0.  rnC'r],  for  any  positive  integer  to.  We  can  upperbound  the  above  equation 
by 


VW  < 


-HO?  -  4^(0)2  +  r(0)(f  (0)/2  +  2q(0)/(rq*))  >  0 

-r(0)2  -  ^q(O)2  -  (2 mC  +  r (0)(to  +  1/2))®  +  «),  f(0)(f (0)/2  +  2q(0)/(rq*))  <  0. 

(6) 

We  can  observe  from  Figure  1  in  Region  I  and  Region  III  the  upper  condition  of  (6)  is  satisfied  and  V (ip)  becomes 


V(ip)  <  -f(0)2  - 


rj-2q*2 


=  -(l-2(Cr)-i)f(0)2- 


Ct  v  2  rq* 

-t\^/n\2  2  q(0)2  +  -4of(0)g(0) 


^-2q*2 


rq 


The  last  part  of  the  above  equation  is  strictly  below  zero  when  ip  is  other  than  0  if  the  condition 


4  1- 


2  16 

> 

q* 


Ct  J  q*2  «*4 


holds.  This  is  true  from  our  assumption  Ct  1. 
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1\ 


III 


=cr 


ri 
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Fig.  1 .  Region  of  V (ip)  in  (6) 


In  Region  II  and  Region  IV  of  Figure  1,  the  maximum  value  of  V(ip)  should  be  reached  for  r  >  0  (Region 
II).  This  is  because  for  every  r  and  q  in  Region  IV,  we  can  choose  —  f  and  —q  in  Region  II  so  that  the  right 
handside  of  (6)  in  the  second  situation  is  larger.  This  argument  can  be  immediately  verified  from  the  existence  of 
the  (2 mC  +  r(0)(m  +  1/2))  term.  So  now  let  us  focus  on  Region  II.  The  part  which  involves  q  is 

-  72^(°)2  -  (2 mC  +  f (°)(m  +  1/2)))c82^2°gl)g(Q)- 

This  reaches  maximum  in  Region  II  at  q( 0)  =  0.  So  we  showed  in  Region  II  and  IV  we  also  have 

V{ip)  <  0. 

Therefore  we  conclude  that  in  all  regions  of  the  state  space,  the  derivative  of  the  Lyapunov  functional  (5)  is  strictly 
below  0  except  when  the  trajectory  is  at  the  equilibrium  state.  Consequently  global  stability  holds.  ■ 

III.  Conclusion 

We  have  shown  in  this  report  by  applying  the  right  Lyapunov  functional,  the  global  stability  condition  for 
the  TCP/AQM  network  can  be  obtained.  From  the  analysis  of  a  single  flow  single  bottleneck  scenario,  we  may 
conjecture  that  for  general  heterogeneous  TCP/AQM  networks,  local  stability  might  imply  global  stability.  It  is 
rather  computationally  demanding  to  apply  this  method  to  multi-flow  multi-bottleneck  system.  We  are  currently 
looking  for  more  efficient  ways  to  analyse  this  system. 
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